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[57] ABSTRACT 

A network multi-media production and authoring sys- 
tem. A J #eaKtjn 5ejaetwork referred to as an "AV LAN" 
is defined. Coupled to the AV LAN are a number of 
shared multi-media production resource devices. These 
multi-media production resource devices include video 
tape recorders, audio tape recorders, video titling de- 
vices, graphics devices, special effects generators, etc. 
Also connected to the A V LAN are a number of work- 
stations which are used to control the production re- 
sources connected to the AV LAN. The production 
resources are connected to the AV LAN through an 
interface unit known as a 'device translator*. The device 
translator is a microprocessor driven device that trans- 
lates coded messages received over the AV LAN into 
specific commands which the particular production 
resource understands. The edit workstations present the 
user with an intuitive graphical user interface that ena- 
bles the user access the various production resources in 
order to create, define, edit, and store elements for use 
in a multi-media production. The scalable nature of the 
AV LAN system allows users to design and build AV 
LAN networks to suit their particular needs. An AV 
LAN system can be as simple as a single workstation 
connected to a single production resource device. The 
AV LAN can be expanded into entire production, edit- 
ing, and post-production studio. This is accomplished 
by coupling together several individual AV LAN net- 
works using a network bridge. Efficient organization of 
such a large system can be accomplished by grouping 
together like kind production resources onto the same 
local AV LAN network. 
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INTEGRATED MULTI-MEDIA PRODUCTION 
AND AUTHORING SYSTEM 

_ d\ 
This application is a continuation in part of parent S 
application, Ser. No. 07/661,694, filed Feb. 21, 1991, 
now abandoned which is a continuation in part of appli- 
cation, Ser. No. 07/622,821, filed Dec. 4, 1990 pending. 

BACKGROUND OF THE INVENTION 1Q 

1. Field of the Invention 

The present invention relates to methods and appara- 
tus to provide an integrated intelligent environment for 
the production and post-production of multi-media 
works. In particular, the present invention relates to the 15 
integration of a plurality multi -media production and 
post-production resources into a networked multi- 
media production and authoring system. The system . 
provides multiple users with control of a plurality of 
dynamically allocated shared resources using a com- 20 
mon intuitive user interface. 

2. Art Background 

A variety-ot resou rces must be integrated, scheduled 
and coordinated4n-the production of a feature film or 
video presentation. Various production mediajresources 25 
such as video, dialog audio . speciaLeijects^ music.audio, 
and graphic^^ust^^editedrandlielectiveiy-mtegrate 
into the overall-production. Consequently, computer 
controlled editing systems and integration methods 
have been used for editing and synchronization of com- 30 
pleted music scores, special effects sequences and the 
like. 

Although present editing systems are capable of ma- 
chine control they provide few capabilities in dealing 
with the content of the actual program being edited. 35 
Frequently, identifiable sequences of a production, such 
as special effects, are accomplished through the use of 
special effects personnel who operate independently of 
the primary director and production scheduler. Dis- 
crete teams of individuals may work on audio editing, 40 
video editing, titles, special effects and other related 
operations required to collectively form a multi-media 
production. For example, suppose an advertisement 
agency decides to produce a beer commercial in which 
the star is a dog. In the final day of post-production, an 45 
executive makes a decision which requires that the dog 
be removed from the commercial and that girls in bi- 
kinis should be inserted as the stars of the commercial. 
If the dog was shot using well-known blue screen image 
technology and inserted in the final production as a 50 
matte layer, it would be easy to remove the image of the 
dog and replace him with the girls in the bikinis. How- 
ever, even assuming that the dog had been shot using a 
blue screen technique, the task remains to remove all 
dog sounds and other elements related to the previous 55 
star. This task is not simple, nor inexpensive, using to- 
day^ technology. 

As will be appreciated from the discussion which 
follows, the elimination of the dog and the replacement 
with the girls may be accomplished during a single edit 60 
session at one workstation utilizing the present inven- 
tion's integrated multi-media production and authoring 
system. Utilizing the present invention, cross media 
links are established between the various production 
resources comprising a multi-media production. Using a 65 
common user interface (see copending patent applica- 
tion, Ser. No. 07/622,821, filed Dec. 4, 1990) the visual 
image of the dog may be removed and the bikinied girls 
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added. Since the audio track with the dog sounds is 
linked to the dog visual image, it is easily removed such 
that an update of all audio and related information is 
completed, necessary to modify the commercial in a 
post-production process. 

The present invention provides an integrated intelli- 
gent studio in which a multi-media production may be 
realized in a coordinated fashion. Multi-media projects 
cover many communication media types, including 
printed materials, audio programs, television shows, 
feature films and many others. The ability to integrate 
the functions of the resources utilized in the production 
of multi-media projects into a single shared system pro- 
vides a level of performance and capability unknown in 
the prior art. A variety of hardware and software tools 
addressing each phase of the multi-media production 
provide machine readable information from the initial 
project conception to completion. The present inven- 
tion's approach of integration permits individual or 
grouped elements in the multi-media production to be 
incrementally added or deleted from the production. 

As will be described, the present invention provides 
the users with total control of all allocated production 
resources through a high-performance multi-media 
workstation. Multiple workstations may be configured 
into a distributed network architecture, each specifi- 
cally configured for a range of tasks, as described more 
fully below. 

SUMMARY OF THE INVENTION 

An integrated multi-media production and authoring 
system is disclosed. The present invention includes a 
plur^itS^Pmulti;media production resources coupled 
to ^reaHime local area networks referred to as "AV 
LANs*'. The production resources are generally placed 
into individual AV LAN networks by job function 
(e.g., audio production resources, video post produc- 
tion resources, etc.). Each production resource, such as 
a video tape recorder or a video production switcher, is 
coupled to the AV LAN through a device translator 
which translates generic device commands received 
over the AV LAN into device-specific commands for 
the particular production resource. Each of the individ- 
ual AV LANs are in turn coupled to one another over 
network bridges. In addition to the various production 
resources, individual "edit workstations", and other 
computers including mini-computers, mainframes and 
personal computers, etc., are coupled to the AV LANs. 
The edit workstations are used to control the produc- 
tion resources located on the AV LANs. Each of the 
workstations utilize the present invention's intuitive 
graphical user interface. The graphical user interface of 
the present invention includes a control frame which, in 
practice, substantially fills the outer border of the dis- 
play screen coupled to a workstation. The control 
frame is comprised of control panels which surround an 
application area, and acts as a consistent user interface. 
The application area is used by the various applications 
to display data. One use of the application area is to 
display view ports of the present inventions "venues" 
concept. The "venues" concept is a method of storing 
information about resources coupled to the AV LAN 
using three-dimensional element representations. "View 
ports" are used to provide a two-dimensional windows 
to view the three-dimensional data elements in three-di- 
mensional venues. A top view port illustrates the time 
relationship between the various resources in a 
"venue". In operation, a user specifies mandatory attri- 
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butes, which an element must have, and optional attri- FIG. 17 is a block diagram illustrating the present 

butes that define the element representing the resource invention's use of an AV LAN for coupling a plurality 

within the application area. Once an element is defined, of resources to workstations and the use of another 

it may be selectively "dragged" down to an event hori- standard computer network for connecting the work- 

zon bar at which time, time data is displayed in the time 5 stations. 

view port of the control frame. Using the intuitive user FIG. 1113 is a detailed block diagram showing one 

interface of the present invention, multi-media elements possible implementation of a workstation for use in the 

may be created, edited, bundled, integrated and rear- present invention. 

ranged along the event horizon. A user may address and FIG. 19 is an illustration of several production re- 
flectively use the production resources coupled to the 10 sources coupled to the present invention's AV LAN 
various AV LANs, and then edit, modify and update through the use of device translators, 
the created work product using the user interface. Ac* FIG. 20 is a detailed block diagram of the internal 
cordingly, an integrated intelligent studio is disclosed workings of a device translator employed by the present 
which permits a plurality of users to access a plurality of invention. 

shared production resources heretofore unknown in the 15 FIG. 21 is a block diagram of a possible embodiment 

prior art. of a video systems network. 

_ fVT ,„ MftvrtrtM „ ^, TT . ^„ A „„„ T ^ FIG. 22 is a block diagram of the software communi- 

BRIEF DESCRIPTION OF THE DRAWINGS Btdbi ^ etmm 

FIG. 1 is an example of a computer controlled video FIG. 23 is a flow chart of a sample edit session using 
editing device that is in the prior art. 20 the present invention. 

FIG. 2 is an artist's conception of a self contained FIG. 24 is a conceptual illustration of the present 
facility for creating an integrated multi-media produc- invention's use of venues to represent data sets of re- 
tion utilizing the teachings of the present invention. sources available to a user. 

FIG. 3 is a block diagram illustrating the network FIG. 25 conceptually illustrates the use of venues and 
topology of the present invention's intelligent studio 25 view ports by the interface of the present invention, 
network. FIG. 26 illustrates operators controlling various re- 

FIG. 4 is an artist's illustration of a control room for sources through the use of the present invention's com- 
the editing and production facilities utilized by the pres- mon user interface. 

ent invention. FIG. 27 is a view of a user display screen utilizing the 

FIG, 5 is a more detailed block diagram of the present 30 control frame and venues concept in the present inven- 
invention's production systems network. tion's graphical user interface. 

FIG. $ is an artist's illustration of one use' of the in- FIG. 28 is the same view as FIG. 27 except with the 
vention to integrate a live action production with spe- element attributes window open for venue selection, 
cial effects and/or outdoor scenes, without the need for FIG. 29 is the same view as FIG. 28 further illustrat- 
the actor to be placed in the actual environment de- 35 ing the present invention's user interface in the display 
picted in the scene. of a plurality of elements and venues selected for the 

FIG. 7 is a more detailed block diagram of the audio production of a multimedia work, 
systems network comprising the present invention. FIG, 30 is the same view as FIG. 29 further illustrat- 

FIG. 8 is an artist's illustration of a studio incorporate ing the element attribute block opened and venue and 
ing the teachings of the present invention for the gener- 40 resource selection. 

ation and integration of audio components into a pro- wotatiom a wo wnMPwn atitpp 

duction utilizing the present invention's common user NOTATION AND NOMENCLATURE 

interface. In the following description, numerous specific de- 

FIG. $ is an artist's illustration of a production studio tails are set forth such as functional blocks representing 
incorporating the teachings of the present invention for 45 data processing devices or networks, window configu- 
the generation and integration of audio components into rations, etc. in order to provide a thorough understand- 
a production utilizing the present invention's common ing of the present invention. However, it will be appar- 
user interface. ent to one skilled in the art that the present invention 

FIG. 10 is a more detailed block diagram illustrating may be practiced without these specific details. In other 
the graphics systems network of the present invention. 50 instances, well known circuits and structures are not 

FIG. 11 is an artist's illustration of the integration of described in detail in order not to obscure the present 
graphics into a production utilizing the teachings of the invention unnecessarily. 

present invention. Some portions of the detailed descriptions which 

FIG. 12 is a more detailed block diagram of the video follow are presented in terms of algorithms and sym- 
systems network comprising the present invention. 55 bolic representations of operations on data bits within a 

FIG. 13 is an artist's illustration of a situation room computer memory. These algorithmic descriptions and 
encompassing control of all networks and resources in representations are the means used by those skilled in 
the facility for final editing of audio, video, special ef- the data processing arts to most effectively convey the 
fects and other resources in a final feature. substance of their work to others skilled in the art. 

FIG. 14 is a more detailed block diagram of the facil- 60 An algorithm is here, and generally, conceived to be 
ity management network comprising the present inven- a self-consistent sequence of steps leading to a desired 
tion. result. The steps are those requiring physical manipula- 

FIG. 15 is a more detailed block diagram of the man- tions of physical quantities. Usually, though not, neces- 
agement information systems network comprising the sarily, these quantities take the form of electrical or 
present invention. 65 magnetic signals capable of being stored, transferred, 

FIG. 16 is a more detailed block diagram of the gate- combined, compared, and otherwise manipulated. It has 
way management network comprising the present in- proven convenient at times, principally for reasons of 
vention. common usage, to refer to these signals as bits, bytes, 
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values, elements, symbols, characters, terms, numbers, 
or the like. It should be borne in mind, however, that all 
of these and similar terms are to be associated with the 
appropriate physical quantities and are merely conve- 
nient labels applied to these quantities. 5 

Further, the manipulations performed are often re- 
ferred to in terms, such as adding or comparing, which 
are commonly associated with mental operations per- 
formed by a human operator. No such capability of a 
human operator is necessary or desirable in most cases 10 
in any of the operations described herein which form 
part of the present invention; the operations are ma- 
chine operations. Useful machines for performing the 
operations of the present invention include general pur- 
pose digital computers or other similar devices. In all 15 
cases the distinction between the method operations in 
operating a computer and the method of computation 
itself should be borne in mind. The present invention 
relates to both apparatus and method steps for operating 
a computer in processing electrical or other (e.g. me- 20 
chanical, chemical) physical signals to generate other 
desired physical signals. 

GLOSSARY OF TERMS 

The following list of technical definitions for certain 25 
terms associated with the present invention is provided 
for this Specification: 

ANALOG ADJUSTMENTS— Reai-Time adjus^ 
ments that are made to production resourceslSver 'the 
AV I^ARThese type of adjustraents-wOuld-riormally^O 
be made using a local control panel or console on a 
production resource. An example might be an audio 
fader, a switcher transition bar, or a key clip adjustment 
on a video switcher. These adjustments are made using 
a Control Console or other assignable input device 35 
connected to an edit workstation and transmitting the 
adjustment over the AV LAN. 

ANALOG ADJUSTMENT HISTORY— The data 
for a series of analog adjustments that are made to a 
production resource which are Time Stamped and re- 40 
corded by the Edit Workstation. The Time Stamped 
information allows the system to accurately re-create 
the series of Analog Adjustments using their relative 
times. 

ASSIGNABLE INPUT DEVICE— An input de- 45 
vice coupled to an edit workstation that may be as- 
signed to perform many different input functions as 
designated by the software. 

ASYNCHRONOUS COMMUNICATION— Com- 
munications that do not have a specific relationship in 50 
time to the system reference. The communications 
themselves may be Time Line or Time Stamped infor- 
mation, but do not occur at an absolute position within 
a frame, or within a guaranteed frame boundary. 

AUDIO TAPE RECORDER (ATR)— A type of 55 
production resource that records audio signals on to 
magnetic tape. 

AUTOMATIC EVENTS— An event that requires 
the synchronization of one or more devices using a 
Time Line, or the automatic positioning of material on 60 
a production resource. The event may involve a pre- 
view or a record of information, or may simply be a cue 
to a particular time code location. 

AV LAN — A defined communications network that 
will couple all of the various devices present in a pro- 65 
duction and post production environment together with 
edit workstations. This will include devices such as 
VTRs, DME units, production switchers, routing 
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switchers, random access recorders, time base correc- 
tors, graphics and animation devices, etc. 

CONTROL CONSOLE— An assignable input de- 
vice which can be assigned to any controllable device 
on the AV LAN. The control console has N number of 
assignable controls (these controls will be similar to an 
endless audio fader, see the copending application 
'Variable Scale Input Device', Ser. No. 07/622;727, 
filed Dec. 12, 1990), and a conventional transition bar 
that will be similar to one found on an effects switcher. 
See copending design patent application entitled "Con- 
trol Console", Ser. No. 07/718,819, filed Jun. 21, 1991, 
and assigned to the assignee of the present application 
for the design of a control console. 

Dl VTR — A Dl VTR is a video tape recorder that 
records video data in a 4:2:2 digital component video 
format. 

D2 VTR— A D2 VTR is a video tape recorder that 
records video data in a 4 f K digital composite video 
format 

DDI DATA RECORDER— A magnetic tape re- 
corder that stores normal digital data. An example of a 
data recorder would be the DIR-1000 Series manufac- 
tured by Sony Corporation. 

DEVICE — A VTR, production switcher, routing 
switcher, time base corrector, DME unit, graphics or 
animation device, etc. In general a device is anything 
that is being controlled via the AV LAN network. The 
terms 'DEVICE' and 'PRODUCTION RESOURCE' 
are interchangeable, 

DEVICE TRANSLATOR— A generic add-on box 
that acts as an initial interface between the AV LAN 
and current devices. The device translator unit has an 
AV LAN network interface, a central processing unit, 
memory, and enough generic I/O to allow it to inter- 
face to the various interface ports of the current produc- 
tion resources. The standard SMPTE RS-422 interface 
is supported. 

DIGITAL MULTI-EFFECTS UNIT (DME)— A 
digital video processing device used to create video 
special effects such as 3D rotations, compression, mir- 
ror, page turns, etc. 

EDIT WORKSTATION— A computer platform 
that is coupled to the AV LAN, and controls the pro- 
duction resources on the AV LAN to create and edit 
multi-media material. Also referred to as 'Workstation*. 
The presently preferred embodiment is a UNIX based 
workstation such as a NEWS tm workstation manufac- 
tured by SONY CORPORATION or a SPARCsta- 
tion TM manufactured by Sun Microsystems, Inc. 

ISOSYNCHRONOUS COMMUNICATIONS— 
Communications that are guaranteed a repetitive time 
slot. Isosynchronous communications are used to trans- 
mit data for audio, video, or Real Time control. These 
applications require a minimum repetitive access to the 
AV LAN network, and a guaranteed minimum band- 
width between two channels. 

LIBRARY MANAGEMENT SYSTEM (LMS) — 
A Library Management System is a large storage and 
replay facility of magnetic tapes. The tapes can be for- 
matted to store video data or normal digital data. 

MANUAL COMMANDS— In general, manual 
commands are commands that could be performed at 
the local console of a production resource by pushing a 
button. Manual commands may put the production 
resource into various modes such as Play, Still, Stop, 
Fast-Forward, Rewind, etc. Manual commands may 
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also change crosspoints on a switcher, or roll a charac- 
ter generator page, etc. 

MEDIA ELEMENTS— The various 'pieces* of a 
multi-media production. They included audio elements, 
visual elements, graphical elements, etc. 5 

MULTI-MEDIA WORK— A multi-media work is a 
work that is comprised of a number of different media 
elements such as video, audio, still photos, music, visual _ 
effects, etc,—^ 

£ -~PLA"Y~LIST— A list of edit decisions that relate 10 
directly to the position of the material on a Random 
Access Device. This list will need to be updated and 
maintained over the AV LAN as edit decisions are 
made. 

PRODUCTION RESOURCE— A VTR, produc- 15 
tion switcher, routing switcher, time base corrector, 
DME unit, graphics or animation device, etc. In general 
a device is anything that is being controlled via the AV 
LAN network. The terms 'PRODUCTION RE- 
SOURCE' and 'DEVICE* are interchangeable. 20 

PRODUCTION SWITCHER— A production 
switcher is a device for cutting between two input video 
signal sources or combining them in a variety of ways 
such as mixing, wiping, and keying to produce an out- 
put video signal. 25 

RANDOM ACCESS DEVICE— A device that can 
randomly access material in Real Time. This type of 
device allows an entirely different mode of system oper- 
ation should the editor so desire. It has a unique require- 
ment for a "Play List'*, or a list of information to be 30 
played to represent a final product. This Play List is 
downloaded to the Device Translator by an Edit Work- 
station, and will then be updated over the AV LAN as 
edit decisions are made. 

REAJ^JME^GONTROL— The ability to control 35 
production resources thru the control console, ASCII 
keyboard, or other assignable input devices connected 
to the Edit Workstation with no humanly perceptible 
time delay. The individual production resources allow 
external control without their own unreasonable per- 40 
ceptiblc time la^_ 

RgALjniME-GOMMUNlCATIONS— Communi- 
cations that are used to make Analog Adjustments and- 
/or control other time critical machine functions over 
the AV LAN. The Real Time Communications require 45 
a guaranteed access to the A V LAN and may need to be 
Time Stamped to allow the Device Translator to recre- 
ate proper command spacing to the Device. 

ROUTING SWITCHER— A routing switcher is a 
hardware device that establishes electrical signal paths 50 
between a number of signal sources and a number of 
signal destinations. Routing Switchers are also referred 
to as "Matrix switchers". 

SLIDER CONTROL— A relative position type 
device that will control the audio levels and other setup 55 
adjustments of the devices connected to the AV LAN. 
The device is a continuous turn belt that will have LED 
indicators associated with it to indicate the current 
position of the assigned control. One possible slider 
control is fully described in the copending application 60 
'Variable Scale Input Device*, Ser. No. 07/622,727, 
filed Dec. 12, 1990. 

TRANSITION BAR— The fader bar located on the 
control console. This device is an absolute position type 
device used to remotely control the audio and video 65 
transitions of the devices connected to the AV LAN. A 
similar device would be the a fader arm of a production 
switcher. 



s 

TIME LINE COMMUNICATIONS— A group of 
commands that are downloaded to a Device Translator 
prior to an event. Each command has associated with it 
a specific time that the command function is to be per- 
formed. As the system clock reaches the times specified, 
the Device Translator executed the commands. All 
Time Line Communication will normally precede an 
Automatic Event. 

TIME STAMPED COMMUNICATIONS— A 
group of commands that are uploaded from a Device 
Translator after an event. Each command has associ- 
ated with it a specific time that the command function 
took place. The Edit Workstation can then use these 
relative times to re-create the event at another time in 
the future. Time Stamped Communications will gener- 
ally follow on automatic event. 

UPLOAD/DOWNLOAD COMMUNICA- 
TIONS— Program or data information that is trans- 
ferred between a Device Translator and an Edit Work- 
station. This information does not have any specific 
time information associated with it. It could be the 
computer software for the Device Translator, or a Play 
List for a Random Access Device. 

VARIABLE MOTION HISTORY— A series of 
Time Stamped speed adjustments that are recorded by 
the Device Translator. As dynamic speed adjustments 
are made over the AV LAN, the Device Translator will 
Time Stamp the actual machine positions (in frames and 
fractions of frames), and store this information in mem- 
ory. This information can later be used to accurately 
re-create the dynamic speed adjustments, or be 
uploaded to an Edit Workstation to be placed in the 
DMS file. 

VIDEO TAPE RECORDER (VTR) — A device 
used to record video signals onto magnetic tape. Ad- 
vanced Video Tape Recorders can be controlled 
through a SMPTE standard RS-422 serial port. Such 
devices are coupled to the AV LAN by using a Device 
Translator which has both an AV LAN network inter- 
face and an RS-422 serial port. 

VIRTUAL INTERFACE— A display on an edit 
workstation screen or virtual reality display, that is 
designed to emulate the interface display of a real physi- 
cal resource such as a VTR, production switcher, or 
DME. 

DETAILED DESCRIPTION OF THE 
INVENTION 

The following detailed description describes the pres- 
ent invention and its various components. The descrip- 
tion which follows relies upon, and hereby incorporates 
fully by reference, the parent copending applications 
Ser. No. 07/661,694, filed Feb. 27, 1991, and Ser. No. 
07/622,821, filed Dec. 4, 1990. The reader is directed to 
the Applicant's copending applications for more de- 
tailed descriptions with respect to the user interface of 
the present invention, as well as the method and selec- 
tion of various functions and menu items within the user 
interface. 

Overview 

In order to simplify the video post -production pro- 
cess, computer controlled video editing systems, such as 
the prior art system shown in FIG. 1, have been cre- 
ated. Such systems are well known in the art. These 
systems employ a control computer to directly control 
a few limited editing resources such as VTRs and 
ATRs. Although these systems are useful, they are 



07/16/2003, EAST Version: 1.03.0002 



5,307,456 

9 HO 

limited in a number of ways. The ability to expand such producers are capable of conceiving, promoting and 
prior art systems is limited by the number of editing directing most project decisions from individualized 
resources that the single controlling computer can ef- multi-media workstations coupled to a variety of net- 
fectively control. These systems lack the ability to dy- works using a common user interface. The present in- 
namically share the post-production editing resources 5 vention provides an integrated multi-media production 
among a number of users operating independently. Fi- and authoring system which may be utilized by a plural- 
nally, such systems have very limited edit information ity of producers in the creation, editing and post-pro- 
storage systems, such as the industry standard EDL duction of a multi-media work product This multi- 
(Edit Decision List), which cannot accurately repro- media work product may comprise a motion picture, 
duce all the adjustments and modifications made at a 10 full-length video, or other similar production. For pur- 
previous edit session. poses of this Specification, the term "production 0 or 
The present invention is designed to remedy such "work-product" is intended to genetically describe all 
limitations of the prior art systems and provide a very such multi-media productions regardless of distribution 
flexible and expandable integrated production and au- media. 

thoring environment. With the present invention, a user 15 As illustrated in FIG. 2, the facility 30 includes multi- 
can start with as little as a single workstation and a pie levels, such as level 32 for editing, post production 
single resource device. As the user's needs expand, and coordination functions, level 34 for total facility 
additional workstations and resource devices are added control, level 36 for graphics creation and integration, 
to the A V LAN network. Multiple AV LAN networks level 40 for audio production and mixing, and level 42 
can be linked together with network bridges. Each 20 for production and filming live action subjects. It will 
workstation added to the AV LAN network is capable be appreciated that although FIG. 2 illustrates a self- 
of accessing and controlling any of the shared produc- contained facility for the production and authoring of a 
tion resources located on the A V LAN network. Work- multi-media work, the present invention may be pre- 
stations can be located at remote sites and have access ticed using facilities that are geographically remote 
to any the production resources on the system network. 25 from one another and coupled over one or more net- 
Software is provided to assist a production from the works for the transmission of digital data, images and 
initial planning and budgeting stage until the final re- the like. Accordingly, the teachings of the present in- 
lease. vention are applicable to distributed computing envi- 
Control of all production resources is given to the ronments, wherein each location communicating with 
user through an intuitive graphical user interface avail* 30 other locations utilize the present invention's common 
able to each workstation. In this manner the director, user interface as disclosed in the parent copending ap- 
producer, or other user need not concentrate on the plication, Ser. No. 07/622,821, filed Dec. 4, 1990 (here- 
technical details and instead is able to directly focus on inafter, the "'821 parent"). 

the creative aspects. However, as the user works with Referring now to FIG. 3, there are numerous compo- 
the system, the system maintains detailed records of the 35 nents comprising the "intelligent" studio of the present 
users actions. These records store information such as a invention. Each of these subsystems is a fully function- 
history of the decisions made by the user, the user's ing AV LAN network within itself, and similarly, as 
workstation preferences, and of course the work prod- will be described, workstations coupled to the networks 
uct created by the user. Thus the system allows users to are functioning resources as well. Not all of the de- 
focus their efforts on the task at hand, while in the 40 scribed subsystems need be present in every system, 
background storing information that will allow an accu- each system is built to meet the particular needs of each 
rate reproduction of the edit' session. individual customer. The intelligent studio system can 
Since the present invention links together many pro- expand as the user's needs change. The term "intelligent 
. duction resources that can be shared by manner users studio", as used in this Specification, refers to an AV 
simultaneously, it allows sophisticated multi-media pro- 45 LAN network with as few as one workstation and two 
ductions involving numerous producers to be created in other production resources integrated together up to a 
"reai-tirne^The real-timejwture^of the invented inte- full studio complex such as the one illustrated in FIGS, 
ateefpre 



2 and 3 as well as a style of operation. As illustrated in 



media production of "live" events such as news events, FIG. 3, the present invention may include various inter- 
concerts, and sporting events. A team of artists, musi- 50 connected networks including a production systems 
cians, reporters, editors, and producers could work network 50, an audio systems network 52, a video sys- 
simultaneously at different workstations producing terns network 54, a graphics systems network 56, a 
graphics, titling, music, commentary, and other media facilities management network 58, a management infor- 
elements. The main producer could then immediately mation service systems network 60, and a gateway man- 
access these individual elements over the AV LAN to 55 agement network 62. The networks are each intercon- 
integrate them and thereby quickly produce a sophisti- nected to minimize the number of "hops" across net- 
cated multi-media output. work bridges a internetwork message must make. With 
_ such a wide variety of production tools being connected 
Example Use of the System tQ ^ fiystem ^ vast of ^formation can be col- 
Referring now to FIG. 2, therein is illustrated an 60 lected and stored during the production of multi-media 
artist's conception of a large facility incorporating the work. This information can be recalled later and used 
teachings of the present invention. The present inven- for such purposes as sequel productions (allowing old 
tion provides an intelligent studio environment to per- sets, props, models, and special effects to be repro- 
mit access by large numbers of "producers" (also re- duced), associated video games, related toy design, and 
ferred to as "users"). A "producer" may be an audio, 65 foreign language translations. As will be described, a 
special effects, video or other multi-media professional common network protocol is used within each network, 
whose function is to provide a specific portion of a as well as to couple the various interconnected net- 
multi-media production. As will be discussed, these works together. Other AV LAN networks can be 
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added as necessary. This Specification will briefly de- ers working at different workstations in real-time. It 
scribe the contents of each of the AV LAN networks will be appreciated by one skilled in the art that the 
disclosed in FIG. 3. One possible embodiment of a ability to "insert" the actor 110 into the background 
"video systems network" will be described in detail in scene 120 on a real-time basis and have the resulting 
order to explain how the network operates. 5 images immediately available to other producers by 

As shown in FIG. 3, the intelligent studio network using the present invention's network topology permits 
includes a gateway management network 62 is coupled multiple edits to be performed quickly ond efficiently, 
to external networks 74, such as Ethernet TM , Inter- For example, utilizing the teachings of the present in- 
net tm , and other networks to communicate with other vention, actor 110 may be inserted into the background 
computer systems and users at remote locations. 10 scene 130 and then background music may be inserted 

Referring now to FIG. 4, an artist's conception of an by others, us will be described more fully below, 
overall facility control room 34 is disclosed which in- Referring now to FIGS. 7, 8 and 9, a possible audio 
corporates and utilizes the teachings of the present in- systems network embodiment of the present invention 
vention. From the facility control room 34 illustrated in relates to all aspects of audio production and authoring. 
FIG. 4, the various production resources can be di- 15 The audio system network encompasses a variety of 
rectly controlled as necessary. functions including audio recording systems 1C0, such 

FIG. S discloses a possible set of resources located on as by way of example audio tape machines, sound stages 
the production system network. The production sys- (See FIGS. 8 and 9) and the like. In addition, the audio 
terns network 50 includes resources such as special systems network includes music scoring systems 143 for 
effects systems 75, audio systems 80, film and video 20 arrangement and music publishing, and sound effect 
systems 84, lighting control systems 86, robotic camera systems H50 for various sound effects (such as wind, 
systems 88, and management information systems 89, lightening, etc.). Mastering replication systems 133 are 
which are coupled to the management information sys- also included within the audio systems network, as is 
terns (MIS) network (not shown), as well as the camera mixing editing and effect synchronization systems 1160, 
control systems 92. In addition, as shown, the gateway 25 and dialog systems 105. The audio systems network can 
management network 62 is also coupled to the produc- be coupled to a device which comprises a MIDI or 
tion systems network, as well as personal media net- similar interface. The audio systems network would 
work workstations 70. As described in the Applicant's then be capable of controlling standardized electronic 
copending '821 parent application, these resources may musical instruments. As shown, the audio systems net- 
be defined and manipulated using the present invcn- 30 work is further coupled to the MIS system 89 and the 
tion's common user interface. gateway management network 62, as well as to the 

The production systems network illustrated in FIG. 5 personal multi-media workstations 70. As in the case of 
incorporates all automatable production tools. Such other networks comprising the present invention, the 
tools may range from various writing and word pro- audio systems network resources are coupled to an AV 
cessing tools in the MIS systems 89, to three-dimen- 35 LAN, which is described in more detail later. 
- sional coordinate system motion control cameras in the Using the example of FIG. 6 and referring to FIGS, 
special effects systems 75. The data produced by each 8 and 9, in the case where background music is to be 
resource, such as the three-dimensional coordinate data inserted into the scene depicted with the actor 110 and 
of such motion control cameras, is stored by the system background 120, a musician such as an electronic syn- 
into a database for future reference. As is apparent from 40 thesizer/piano musician 122 may view the combined 
the various illustrations accompanying this Specifica- scene created using the teachings of FIG. 6 while insert- 
tion, many of the networks associated with the present ing the background music. An operator 124 illustrated 
invention overlap and are coupled to one another. Ac- in both FIGS. 8 and 9 seated behind a workstation 
cordingly, all the systems represented in the intelligent located on the audio systems network directs the actual 
studio network of FIG. 3, can communicate with the 45 recording of the music score. Using the graphical user 
resources and workstations located on the network of interface of the present invention disclosed in the '821 
PIG 5, and '694 parent applications, the operator 124 may se- 

FIG. 6 is an artist's rendition of a sample of the use or lectively insert the music score at the appropriate times 
the production systems network of the present inven- into the production. The operator 124 may also insert 
tion. As illustrated, a production sound stage 100 in- 50 sound effects from a sound effects library resource lo- 
cludes an actor 110 wearing mountaineering equipment. cated on the audio systems network as appropriate. 
A display screen 113 is included within the production Referring now to FIGS. 10 and I!, the present inven- 
facility illustrated in FIG. 6. A background mountain tion further includes a graphics systems network which 
scene generally referred to by the numeral 120 com- incorporates many aspects of graphic design environ- 
prises motion picture film or video tape previously shot 55 ments including, two-dimensional animation, three-di- 
at a remote location. As will be apparent from the dis- mensional rendering and animation, cell animation and 
cussion which follows, the present invention permits other traditional mediums of graphic design. One of the 
the super-position of the actor 110 onto the background attributes of the integrated intelligent studio environ- 
scene 120. The actual super-position of the actor 110 ment (See FIG. 3) of the present invention, is the capa- 
into the background is accomplished by a user using an 60 bility to define relationships between normally unre- 
edit workstation 125 incorporating the teachings of the lated information types. For example, an operator may 
present invention's user interface disclosed in the '821 develop a system to recognize n relationship between a 
parent application. (Also see Applicant's copending foreground object and a background object. Having 
application, Ser. No. 07/622,694, filed Feb. 27, 1991, trained the system to recognize the foreground object, 
hereinafter the *"694 parent".) The resulting images are 65 the system could then automatically extract the fore- 
available for use by other producers working on other ground information from an image sequence. Another 
workstations connected to the network system. Thus, a feature could be to provide an image compositing work- 
series of edits can be accomplished by different produc- station that understands the coordinate space of each 
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image. This would provide a high level relationship common intuitive user interface presented on their 

allowing the operator to choreograph live action with workstations. 

3-D and 2-D animation and other effects. With reference now to FIG. 14, the facility manage- 
As illustrated in FIG. 10, a graphics systems network ment network is illustrated. Although the AV LAN 
embodiment could include resources such as video sys- 5 network is generally geared towards the control of 
terns 180, paint systems 185, and 2-D animation systems multi-media production resources, the AV LAN can be 
188 coupled to an AV LAN topology. Library systems used to control just about any electronic device that can 
150 are provided within the graphics systems network be connected a computer network. Parameters such as 
such that various graphics may be electronically stored temperature, lighting levels, ambient noise, fire alarms, 
in a database, and accessed by other systems coupled to 10 elevators, security and others can be controlled by a 
the graphics systems network, or the integrated user &cffity configuration network and monitoring worksta- 
environment at large. 3-D animation systems resources tions A possible implemenUtion of faculty - control 
192 are also coupled to the graphics network, as are the ™*! to ^corporate intelligent device control lope 
audio systems 198 described with reference to FIG. 7, t ?*> every de # vlcc ? ^TZ^aL c^ 
and the MIS System 89. Various titling systems 200 are » TM system by Ec helon o ™^^J£ 
coupled to the graphics systems network, as are the «* command and status conimuiucations with aH the 
vuupcu & * P w jr , facility controls permits the present invention to store a 
gateway management network 62 and personal med* j^"^ ^ eaBBgfa J aiL ^ enables operators 

workstations 7U - j • to store their particular preferences for various parame- 

As shown m FIG. 11 a graphic artist 210 may design ^ prefe ? enccs a t future sessions These 

various graphic images 215 using, for examp e, the 3-D ferences mclude parameters such as system routing, 

ammation system P atchin *' room li * ht leve1 ' ro0m temperature, 

to by the numeral 220 in FIG. 11. Once the three-di- B eferences for actors ^ staff md ^ othcr 

mensional images are complete, they may be stored t of a sessiont As mustra ted, the facility manage- 

using the library systems resources 190, or inserted into ^ ^work is coupled to the database library systems 

a multi-media production using the graphical user mter- resources 19u , environmental control systems 260, secu- 

face of the present invention's copending 821 and 694 rfty systems 2 70 t and lighting systems 275. In addition, 
parent applications on a workstation. .the facility management network is coupled to fire mon- 

Referring now to FIG. 12, a possible embodiment of itodng systcms 280, and the audio/video networks de- 

a video systems network is disclosed. The disclosed 30 scrihtd with reference to FIGS. 7 and 12. As with the 

video systems network includes resources used in the othef networ t S) tne facility management network is 

recording, editing and duplication of video programs. coupled to the MIS Systems 89 and gateway manage- 

The video systems network integrates the video, audio, menl networ k 62, as well as to personal multi-media 

and graphic elements of the multi-media production, workstations 70. 

through the use of a workstation implementing the 35 Referring to FIG. 16, the MIS Network Systems 89 is 
common graphical user interface of the present inven- disclosed in more detail. All aspects of logistics and 
tion's parent applications. A user accesses and controls operations may be accommodated by an MIS System, 
the necessary video production resources using the For example, one function of the MIS Network System 
workstation, which sends out the appropriate com- 39 wou id be to provide the budget information for a 
mands over the A V LAN (See FIG. 18). Accordingly, 40 production from the initial conception to the final re- 
multiple versions of a sequence of a multi-media pro- lease. Other aspects of logistics and operations would 
duction may be created and tested in a shorter time provide valuable information for project management, 
frame than otherwise possible using prior art produc- ^ act ^ a significant asset in building a knowledge 
tion methods. As illustrated in FIG. 12, the video sys- oase f or use by an expert system. As shown, the MIS 
terns production network includes mixing and layering 45 Network Systems 89 comprise, and is coupled to, logis- 
systems resources 230, routing and configuration sys- tics systems 300, mainframe systems 310, operation sys- 
tems resources 235, mastering replication systems re- terns 315, and accounting systems 320. As is the case 
sources 240, and editing/data base and synchronization with the other networks comprising the present inven- 
systems 245. In addition, the video systems network is tion, the MIS Network Systems 89 is coupled to the 
coupled to the special effects systems resources 75 and 50 gateway management network 62 and personal multi- 
audio systems resources 80. The title and graphics sys- media workstations 70. 

terns 250 are also provided, as is network interconnect Referring to FIG. 16, the gateway management net- 
between the MIS System 89 and the gateway manage- WO rk 62 has a primary function to coordinate the exter- 
ment network 62 and personal multi-media worksta- nal communications with the intelligent studio network 
tions 70. 55 (See FIG. 3). These external communications may 

By having access to standardized or custom data- range from various electronic mail services over a 

bases, such as library systems 190 and other resources, phone line, to high definition video signal transmission 

the video systems network using the present invention's over a fiber optic link. The gateway network manage- 

unique user interface permits efficient video editing of ment system also provides security for external connec- 

multiple takes, versions, and production segments. 60 tions. Moreover, as previously discussed, the intelligent 

Referring to FIG. 13, a situation room which has studio of the present invention may be accessed by and 
access to the video systems network is illustrated. In effectively used by workstations located at remote loca- 
FIG. 13, a group of directors are making edit decisions tions. This decentralization of resources could extend to 
and directing a group of users in the final editing of a the various producers' homes. For example, it is possi- 
multi-media production. The users are able to access 65 ble for a producer to have the "master" tapes of a pro- 
audio elements, video elements, special effects, and duction at a post production house, and after complet- 
other multi-media elements from the resources present ing an off-line session on the producers* personal multi- 
on the video systems network AV LAN through the media workstation 70, the producer allocates the equip- 
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ment required at the post production facility and per- The AV LAN 420 comprises a high-speed digital 
forms the edit session from his home or office. This communications network with a data transmission rate 
approach maintains the quality of the imagery through greater than 100 Megabits per second. In the presently 
the use of high quality studio equipment located at a preferred embodiment, the AV LAN 420 comprises a 
remote site. As illustrated, the gateway management 5 FDDI (Fiber Distributed Data Interface) d^talcom- 
network 62 utilizes a standard consistent AV LAN puter network. The AV LAN network 420 is used for 
protocol, but includes access to FDDI Network Sys- real-time control of production resources, and includes 
terns 340, X.25 Systems 345, ISDN Phone Systems 330, three separate time references. An B^ute reference is 
SNA Systems 360. Satellite Systems 365, direct phone maintained by all resources coupled to fce ^ork 
lines 370, Ethernet tm Systems and Interfaces 375, as 10 such that data may be time stamped ^ ^Uons and 
well as other network systems resources 3*0 * re- ^ ^ 

q With respect to the personal multimedia works*- £^ 3E S£ 

tions disclosed in the figures the purpose of the work- ^ Q ^ ^°^ f ° ture * provided t0 aV oid the 
stations istoem^ ^ * ^transmit information in what is referred to as 

ate ideas and forrnulate decisions on a personal basis a ofrser mode , and variable references are 

home or in the ofTice. The producer can ^ access an> , of J ^ on ^ ^ re . 

the production resources available on the AV LAN th f oetwork> In Edition, well 

through an intuitive graphical user interface Mto create, ^ %Xm ^ such ^ SMPTE time codes ore used 

edit, and store multi-media productions. Of course, ^ & standafd m ^ various resource$i such as 
more traditional computer software such as word pro- fecorders ^ audio tape recorders 440, etc. 

cessing, spreadsheet, and accounting software is also for hronization purpoS es and communication pur- 
available to the user. The individual ^workstations ^ Moreover, the particular protocol utilized by A V 

ideally comprise high performance UNIXtm based 2$ LA N 420 to cormiiunicate with the edit workstation 655 
workstations such as Sony NEWS workstations or and vario us resources coupled to the AV LAN 420, 
workstations manufactured by Sun Microsystems, Inc. ^ a ^0^^ protocol or a commercially avail- 

of Mountain View, Calif. However, the scalable nature abJe protoco i t 
of the present invention allows an "edit workstation" to 

comprise any computer system connected to the AV 3Q IMPLEMENTATION OF THE WORKSTATIONS 
LAN from a personal computer to a super-computer. With re f erence to FIG. 38, a detailed embodiment of 

Implementation of the AV LAN * P°"ible workstation employing the teachings of the 

present invention is disclosed. As illustrated, the work- 
Referring to FIG. 17, the networks of the present station is a computer 300, which comprises six major 
invention used to control production resources, such as 35 components. The first of these is a Central Processing 
the audio systems network of FIG. 7, the graphics sys- Unit ("CPU* 1 ) 310 which is coupled to a memory 315. 
terns network of FIG. 10, or the video systems network ^pij j^q ^ memory 315 are further coupled to a disk 
of FIG. 12 communicate over a real-time control net- input/out (I/O) circuit 323, for communicating with a 
work referred to as an AV LAN 420. FIG. 17 is a sim- jj ar< j dr i V e 330 for mass storage of data. Computer 
plified block diagram of a generic network system com- ^ $qq further includes a peripheral input/output (I/O) 
prising the present invention. As illustrated in FIG. 17, circuit 333 for communicating with external assignable 
many different types of computers may be coupled to mpu t devices over bus 340. Possible external assignable 
the AV LAN 420 such as personal workstation 400, a devices include digitizing pad 543, keyboard 350, 

mainframe system 410 and/or a mini-computer system track ball input device 360. A display monitor 800 

415. As illustrated in FIG. 17, the computers 400, 410 45 i s illustrated which is used to display the graphical user 
and 413 are coupled to an AV LAN network 420, interface of the present invention, as disclosed more 
which will be understood to comprise the networks f u n y herein and is the subject of copending '821 and 
disclosed in the previous figures, such as the video sys- »6$4 parent applications. The display monitor 800 is 
terns network, audio systems network and the like. Also coupled to the user interface display circuit 320. 
coupled to the AV LAN 420 are various production 50 Computer 300 also includes a network interface cir- 
resources such as video tape recorders 425, production cu ft 380, which permits the computer 300 to communi- 
switchers 430, routing switchers 435, and audio tape cate with any of the resources located on the AV LAN 
recorders 440, as well as a plurality of other resources. 420 or to other devices located on other network sys- 
The audio and video signals 480 of the production re- terns through the gateway management network 62. 
sources are all coupled to routing switcher 435 which 55 Also as illustrated, a variety of production resources 
directs the audio and video signals signals as necessary. such as a video tape recorder (VTR) 602, music synthe- 
Examples of other resources which may be coupled to sizer 604, audio tape recorder 606, and production 
the AV LAN 420 include resources such as paint sys- switcher 608 are coupled to the AV LAN network 420 
terns 185, library database systems 1£0, video systems through their respective device translators 610, 612, 
160, and other production resources previously de- 60 614, and 616, respectively. As will be described more 
scribed with respect to the various networks associated fully below, the present invention as illustrated in FIG. 
with the present invention in FIGS. 3, 7, 10, 12, and 14. 10 permits media elements from production resources 
In addition to the AV LAN 420, the computers 400, 410 such as VTR 602, music synthesizer 604 and audio tape 
and 413 are coupled to a standard computer local area recorder 606 to be accessed by using the present inyen- 
network 450. The local area network is used for non- 65 tion's graphical user interface. A user/producer view- 
real time communication between computers 400, 410 ing the graphical user interface on display 600 may 
and 415 such as data transfers, command transfers, and utilized one or more of a variety of assignable input 
other operations. devices, such as keyboard 350 or trackball 560, to select 
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and control the various media elements in order to 
develop a unified multi-media production. In addition 
to the various assignable input devices illustrated in 
FIG. 18, other external input devices may be utilized 
such as a variable scale input device which is the subject 
of a copending application assigned to the assignee, 
Sony Corporation of America, and having Scr. No. 
07/622,727, filed Dec. 15, 1990, and incorporated fully 
herein by reference. A variable scale rotary switch, also 
the subject of a copending U.S. patent application as- 
signed to the assignee of this application having Ser. 
No. 07/679,745, filed Apr. 3, 1991, may be used as an 
input device. Moreover, various input devices may be 
combined into a unified control console as disclosed in 
copending design patent application entitled "Control 15 
Console". Ser. No. 07/718,819, filed Jun. 21, 1991, and 
assigned to the assignee of the present application. 

It will be appreciated that the workstation of the 
present invention, as illustrated in FIG. 18, is only one 
possible embodiment of many. For example, although 20 
only one computer S00 is shown, the present invention 
may include multiple workstations coupled to the AV 
LAN 420. Each of these workstations coupled to the 
AV LAN 420 may execute separate programs, and 
support different versions of the user interface of the 25 
present invention. In addition, each of the workstations 
coupled to the AV LAN 420 may operate quite inde- 
pendently of one another with respect to resources 
coupled to any one of the plurality of networks (for 
example, the graphics systems network or audio sys- 
tems network, etc., illustrated in FIGS. 5, 7, 10, 12, and 
24). It is contemplated that the use of multiple worksta- 
tions will support the present invention system distrib- 
uted computing, wherein multiple versions of the pres- 
ent invention's user interface may be supported concur- 
rently, each of the multiple user interfaces executing 
different processes but having a common database of 
resources. As such, it will be noted that the embodiment 
shown in FIG. 18 is a simplified embodiment for pur 



30 



35 



Referring now to FIG. 20, a detailed block diagram 
of a possible device translator (Such as 612 from FIG. 
19) embodiment is shown. As illustrated, the device 
translator comprises two main functional blocks, the 
AV LAN interface block 700 and the device translator 
block 724. The AV LAN interface 700 includes a net- 
work interface circuit 710 which is coupled to a net- 
work processor 714, The network processor, as is 
known in the art, controls the transmission and receipt 
of messages on the AV LAN 420 network. A RAM 
buffer 716 is coupled to the network processor 714 for 
storing incoming and outgoing AV LAN communica- 
tion messages. In addition, a programmable array logic 
(PAL) device 720 is coupled to the network processor 
714. The PAL 720 identifies the network address associ- 
ated with the particular device translator and produc- 
tion resource. Commands and data transmitted over 
AV LAN 420 are directed to one or more network 
addresses associated with the various production re- 
sources. The command message may consist of a single 
command or contain a series of automatic events which 
are to be executed by the device on a time-line. Only the 
messages directed to the appropriate network address as 
stored within the network address PAL 720 are cap- 
tured by the network processor 714. These messages are 
then forwarded to the circuitry located in the device 
translator block 724 which translates the received mes- 
sage into specific device commands for the production 
resource associated with the device translator. 

The device translator block 724, as illustrated in FIG. 
20, includes a microprocessor 726 which translates and 
converts commands and data transmitted over the AV 
LAN 420 into the device specific command types and 
formats required by the particular resource to which 
the device translator is coupled. For example, com- 
mands transmitted to a video tape recorder could be 
translated into the commands PLAY, RECORD, 
FAST-FORWARD, REWIND, JOG, STILL, and 
STOP, Each type of production resource has its own 



poses of illustration only, and is not meant to limit the 40 set of ballistics factors which define the dynamic perfor- 
present invention's utility. mance of the device. For example, the acceleration 

from STOP to RECORD speed, the wind-motor 
PRODUCTION RESOURCES AND DEVICE speedSj ^ ree , sizes m bandies factors which define 
TRANSLATORS the p er f orma nce of a video tape recorder. These ballis- 

Referring now to FIG. 19, a more detailed block 45 tic factors vary among models and manufacturers. To a 
diagram illustrating the AV LAN 420 of the present lesser degree, even identical models from the same man- 
invention is shown. In FIG. 19, an edit workstation 655 ufacturer will differ slightly. To compensate for these 
(Such as the computer 500 of FIG, 18) is coupled to the different characteristics, each production resource has 
AV LAN 420 which allows the workstation to access its own dedicated device translator software that is 
the numerous production resources located on the AV 50 specially tailored. 



LAN 420. Edit workstation 655 corresponds to per- 
sonal workstation 400, or alternatively, to mainframe 
410 or mini-computer 415 of FIG. 17. Each of the pro- 
duction resources coupled to the AV LAN 420, such as 
VTR I 602 or music synthesizer 604, are coupled to the 55 
AV LAN 420 through an associated device translator, 
which will be described below. The coupling between 
the device translator and the production resource varies 
depending on the nature of the production resource. 

For example, in the case of a video tape recorder 602, in 60 permits fast direct memory access operations. In addi- 
the presently preferred embodiment line 665 comprises tion to other DMA operations, the DMA controller 745 
a 38.4K baud RS-422 SMPTE standard serial connec- permits DMA operations for purposes of protocol 
tion. However, it will be appreciated that other cou- translation (Le., translation of commands, operations 
plings, such as a RS-232 serial connection, a parallel and data) for data buffered in a RAM 760 which is also 
connection, or a MIDI connection for standardized 65 coupled to the data bus 728. 

musical instruments, may be used to couple the various ROM 775 is coupled to the address bus 730 and the 
production resources to their respective device transla- data bus 728. The ROM 775 contains the microproces- 
tors. sor code necessary to drive the device translator as a 



In the presently preferred embodiment, the micro- 
processor 726 comprises a Motorola MC680x0 micro- 
processor. In addition, as illustrated in FIG. 20, micro- 
processor 726 is coupled using a 32-bit bus to a address 
bus 730 over lines 740. As illustrated in FIG. 20, a direct 
memory access (DMA) controller 745 is provided 
within the device translator, and is coupled to the ad- 
dress bus 730. In addition, the DMA controller 745 is 
coupled to the data bus 728. The DMA controller 745 
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generic translating device. A control/status register 783 synthesizer 604) through the interface circuit 040, or 
and a counter timer 750 are provided as part of the alternatively, through the parallel I/O port 855 
device translator and are coupled to the data bus 728. In It will be appreciated by one skilled in the art, that the 
addition, other support circuitry is provided within device translator illustrated in FIG. 20 is a generic 
each device translator such as an interrupt encoder 000 5 translator which may be used for several different types 
which is coupled to the control bus 732. Interrupt en- of production resources. Depending upon which re- 
coder 800 provides appropriate interrupt signals to the source is coupled to the device translator, a specific 
microprocessor 726 as may be required. A bus arbitra- translation data set is loaded into the device translator 
tion circuit 810 is also coupled to the control bus 732. RAM 7(50. The translation data set is used by the micro- 
The bus arbitration circuit 810 arbitrates the bus re- 10 P«««iot to translate the messages r^'ved from the 
quests of the various devices located on the bus such as AV LAN 020 into commands that ^ be understood by 
the DMA controller 705. the serial interface 000, and associated 'fT** ,V?kv 
token ring processor 714. A strobe generator 815 is mt0 .** ^"^Sj^L A> 

provided Ld coupled to the control bus 732 for provid- w ^ «° ""T"? ^ ^L^ ^J^^r 
• • * * i. / u d a c j pa c\ 15 such, the device translator is designed to act as a univer- 

jag appropriate strobe (such as RAS and CAS s^als * such 

for memory access and synchronization purposes that any resource coupled to the device translator will 

Other Cl ™*y receive'commands, date and other instructions in the 

includes a date transfer acknowledge (DTACK) gener- ^ fe$ourcc regardless of 

ation circuit 820, coupled to the control bus 732, and an ^ ^ ^ ^ Ay ^ m of ^ binafy 

address decoding circuit 823. ofderg f ^ works tations themselves (e.g., workstation 

Continuing to refer to FIG. 20, each device translator 
includes an interface circuit 840 which couples the asso- Actively, a specific translation data set for a 
dated resource (e.g. VTR $02) to the device translator ^cute production resource can be preprogrammed 
as illustrated. The interface circuit 840 vanes depending 2J imo thft deyice Uanslator ROM 775. By preprogram- 
on the type of resource to be connected. A parallel ming the translation data ^ mt0 thc de vice translator, 
input/output (I/O) interface 833 ts also provided and <he AV LAN network ma i ntC nance can be simplified 
coupled to the data bus 728. In the presently preferred md network traffic ^ ^ re duced. 
embodiment, the input to the parallel I/O interface 855 

comprises 24-bit parallel lines 863. Finally, a sync strip- 30 An Example AV LAN Network 
per 870 is provided within each device translator to To morc fully eX p|ai n ftc operation of an AV LAN 
appropriately sync strip video signals, as may be re- ne twork, a possible embodiment of a video production 
quired. network is disclosed in FIG. 21 . This embodiment is just 
In operation, each resource is coupled to one of the onc po SS jblc network configuration and is not intended 
an AV LAN 420 networks, such as the audio systems 35 t0 fa invention. Like the AV LAN system of 
network of FIG. 7 or graphics systems network of FIG. pj^ j$ tnc LAN system of FIG. 21 comprises edit 
10, through a device translator as illustrated in FIGS. workstations 400 and a set of production resources, 
18, 19, and 20. In addition, a number of workstations are sucn production switcher 472 and Digital Multi-Effects 
coupled the AV LAN 420 networks. It will be appreci- (DME) unit 473, coupled to an AV LAN 420. Each of 
ated from the Specification that a workstation coupled ^ tnc production resources such production switcher 472 
to any of the AV LAN networks may, using the present ^ Digital Multi-Effects (DME) unit 473 are con- 
invention's common user interface, allocate and control nected to the AV LAN 420 through a device translator 
the various resources coupled to any of the associated (each labeled M DT") such as the one disclosed in FIG. 
networks. Accordingly, a workstation coupled to, for 20. As previously illustrated in FIG. 17, the edit work- 
example, the graphics systems network of FIG. 10, may 45 stations in FIG. 21 are also coupled to a standard corn- 
access a resource such as music synthesizer 604 con- pu t e r network 430 which is used for non-real-time com- 
nected to the audio systems network of FIG. 7. Using a munications. In addition, a network file server 415 is 
protocol previously defined for use on the AV LAN coupled to both the AV LAN 420 and the computer 
420, the workstation (e.g., edit workstation 635) may network 430. The audio and video signals 480 of the 
issue commands such as stop, start, record, fade, etc. 50 various production resources are all connected to rout- 
The commands issued by a user/producer operating an ing switcher 471 which directs the audio and video 
edit workstation are transmitted along the AV LAN signals as needed. The routing switcher 471 directs 
420. The device translator receives the command trans- audio and video signals 480 in response to commands 
mitted by the workstation (e.g., workstation 653) received over the AV LAN 420. 
through the network interface 710 (see FIG. 20). The 55 Also coupled to the AV LAN 420 is a multi-format 
resource network address contained in the message Library Management System (LMS) 460 which serves 
transmitted over AV LAN 420 is compared to the net- as the main data storage facility for the video produc- 
work address stored within address PAL 720 by the tion network of FIG. 21. The Library Management 
network processor 714. An address match identifies the System 460 is made up of a large library of bar-coded 19 
command as being destined for the music synthesizer 60 mm tapes 461; a collection of different 19 mm tape 
604, in this example. The command is forwarded by the decks 464, 465, and 466; and a Library Management 
network processor 714 into the device translator RAM System control computer 463. A Library Management 
760. The microprocessor 726 then translates the desired System 460 is not required for an AV LAN configura- 
command (e.g., stop, start, etc.) from the AV LAN tion, it is merely one of many possible production re- 
protocol into commands understood and executable by 65 sources that can be connected to the AV LAN net- 
the music synthesizer 604. The translated command is work. The function provided by the Library Manage- 
then sent by the microprocessor 726 to the associated ment System 460 could also have been provided by 
production resource (in the present example, music individual video tape decks. However, since the LMS 
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has the capability to provide access to a large number of 
video tapes simultaneously, the LMS is ideal for broad- 
cast stations or large post-production studios. 

The tape library 461 of the Library Management 
System 460 consists of a number of 19 mm tapes which 
can be formatted in a number of different formats. Two 
of the possible tape formats are used for storing video 
digitally. A first digital video data format is used by 
"SMPTE Dl" video tape recorders (Dl VTR) 464. Dl 
video tape recorders 464 store video data in a standard- 
ized digital component video format entitled "4:2:2". 
The second type of digital video data format is used by 
"SMPTE D2" video tape recorders (D2 VTR) 465. D2 
video tape recorders 465 store video data in a digital 
composite video format entitled "4 f rc ". Another possi- 
ble format used by 19 mm tapes is a normal digital data 
format used by "DDI** digital data recorders. Such 
recorders use formats such as the ANSI X3B.6 ID-1 
standard. This is a normal digital data format that is not 



10 
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Object-Oriented Database Server extracts the record 
from the element database and gives it to the client 
process. 

The second control process running on the network 
file server 415 is a Resource Allocator and Routing 
Manager. As the name implies, this control process 
serves two purposes. The Resource Allocator part of 
the control process manages the sharing of the various 
production resources among the users running client 
processes at each workstation by controlling the alloca- 
tion of the production resources located on the AV 
LAN 420. The Routing Manager part of the control 
process controls the routing of the audio and video 
signals 480 in FIG. 21 so that when a resource is allo- 
cated to a user at a workstation, the audio and video 
signals are directed appropriately. Associated with the 
Resource Allocator and Routing Manager is a Resource 
and Routing database. This database stores the current 
state of each production resource (free, busy, broken, 



dedicated for any one specific use. Each 19 mm tape 20 etc.) and the current routing of the audio and video 



formatted with digital data can store up to 770 Giga 
bytes of digital information. Each 19 mm tape in the 
tape library 461 is labeled with a bar-code label that can 
be read by a Library Management System control com- 
puter 463. The barcode label reveals the name of the 25 
tape and the format (such as 4:2:2 component video, 4 
f sc composite video, or DDI digital data) of the data 
contained on the tape. The Library Management Sys- 
tem control computer 463 uses the bar-code label to 



signals. When a user running a client process at a work- 
station requests a production resource, the Resource 
Allocator first checks the database to see if the produc- 
tion resource is available, if it is then the Routing Man- 
ager routes the audio and video signals appropriately 
and gives control of the resource to the client process at 
user's workstation, such that the user may now use the 
resource. 

Closely related to the Resource Allocator and Rout- 
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load the appropriate tape into the appropriate tape 30 ing Manager is a Resource Maintenance program. The 

Resource Maintenance program examines the resource 
database and periodically instructs the production re- 
sources that are not currently being used to run internal 
diagnostic tests. In this manner, the health of the pro- 
duction resources located on the AV LAN can be moni- 
tored automatically. The Resource Maintenance pro- 
gram can also direct the Routing Manager to connect a 
production resource's audio and/video output signals to 
a test device that would monitor the quality of the sig- 
40 nals. If the signal quality from the production resource 
were to deteriorate, the Resource Maintenance pro- 
gram would recommend maintenance on that produc- 
tion resource. In this manner the health and mainte- 
nance of all the production resources may be monitored 
in a well organized manner. 

To demonstrate how the AV LAN system software 
operates, a sample edit session will be explained with 
reference to FIGS. 21, 22, and 23. In step 1 of FIG. 23, 
a user initiates an editing session starting a client process 
on an edit workstation that establishes a software com- 
munications link to the Object-Oriented Database 
Server. The user then "signs on" to the system by enter- 
ing a user name and password. The Object-Oriented 
Database Server uses the user's identity to initiate an 
edit session with the user's preferred settings which 
were recorded from earlier edit sessions. The user then 
makes a request for the necessary data which the work- 
station client process transmits to the Object-Oriented 
Database Server. 

Having received the user's data request, in step 2 of 
FIG. 23 the Object-Oriented Database Server analyzes 
the data request and extracts the necessary data records 
from the element database. If the data records requested 
also require associated production resources, the Ob- 



deck. 

The multi-format Library Management System 460 
contains a number of 19 mm tape recorders to play the 
19 mm tapes in the library. The Library Management 
System 460 shown in FIG. 21 contains two Dl video 
tape recorders 464, two D2 video tape recorders 465, 
and one DDI digital data recorder 466. The Dl video 
tape recorders 464 and D2 video tape recorders 465 are 
each connected to the AV LAN 420 through a device 
translator (each labeled DT) and are controlled by com- 
mands received over the AV LAN 420. The DDI digi- 
tal data recorder 466 is coupled to the network file 
server 410 through a high-speed interface 467 such as a 
"HIPPI" bus. The DDI digital data recorder 466 serves 
mainly as an archival mass storage device. 

Loading the individual tapes from tape library 461 
into the various tape recorders (464, 465, and 466) is the 
Library Management System control computer 463. 
The Library Management System control computer 
463 is coupled directly to network file server 410 which 50 
directs the LMS control computer 463. 

AV LAN Control Software 

Referring to FIG. 22, a block diagram of the software 
communications architecture is disclosed. On the top of 55 
FIG. 22 is a dashed box that represents the network file 
server 415 of FIG. 21. Two control processes run 
within the network file server 415 which control the 
overall management of the particular AV LAN. These 
two processes act as "servers" to "client** processes 60 
running on each edit workstation. The first control 
process is an Object-Oriented Database Server. The 
Object-Oriented Database Server is responsible for 



managing all the data elements created by users of the 

AV LAN system. Associated with the Object-Oriented 65 ject-Oriented Database Server requests the necessary 

Database Server is an Element database which stores all production resources from the Resource Allocator and 

the data elements. When a client process running on an Routing Manager. For example, the user may request a 

edit workstation requests a data element record, the video data element that requires an associated video 
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tape recorder. The Resource Allocator allocates the Database Server also returns the production resource 
needed production resources and updates the Resource allocation information to the Resource Allocator. The 
database, marking the allocated resources as "busy". Resource Allocator marks the returned production 
The Routing Manager makes the necessary connections resources as "free" so they may now be accessed by 
on a routing switcher to connect the allocated produc- 5 other users. 

tion resources together. Information about the allocated As previously mentioned, the present invention uses 
production resources is returned to the Object-Oriented an distributed object-orient database, such as "Object- 
Database Server. Store" by Object Design of Burlington, Mass., to orga- 

After obtaining data records and the production re- nize and store the data elements created by the users, 
sources, in step 3 of FIG. 23 the Object-Oriented Data- 10 The use of an object-oriented database allows a user of 
base Server finally delivers the data records and alio- the present invention to create links between any of the 
cated production resource information to the client data records. When the user has finished his edit session, 
software running on the user's workstation. Referring the modified data records are sent to the Object-Ori- 
to FIG. 22, the data record and resource allocation ented Database Server which then updates the master 
information travels from the network server to the cli- 15 element database to include all of the new links. The 
ent process running on the edit workstation 400 over advantages of using an object-oriented database are best 
the standard computer local area network 430. demonstrated by an example. 

In step 4 of FIG. 23, the client process running on the Suppose a producer is using the present invention to 
edit workstation now has direct control over the data it produce a dramatic television show. While in the "edit 
has received and the production resources allocated to 20 mode" editing a scene, the producer may decide that a 
it. The client process can edit and modify the data re- scene needs to be rewritten or modified. The producer 
cords it has received within the edit workstation. The may then switch to "plan mode" to bring a up a word 
client process may also directly control the production processor in order to make a few notes on how the 
resources that have been allocated to it. Referring to scene should be changed or modified. He may then 
FIG. 22, the client process on the workstation controls 25 "attach" his notes to the scene, so that his notes will 
the allocated production resources by sending com- reappear when reviewing the scene later. The object- 
mands over the AV LAN 420. The production re- oriented database accomplishes this by creating a "link" 
sources can also send messages over the AV LAN 420 between the video scene and the word-processor data, 
back to the controlling client process running on work- The producer can also use such notes to indicate when 
station 400 when an error occurs or when status is re- 30 certain sound effects should be added to the scene. The 
quested by the client process. information can then be given to a foley artist (sound 

During the edit session in step 4 of FIG. 23, a user effects specialists) who will examine the scene contain- 
may wish to perform an operation that requires a data ing the producer's notes and replace then with the ap- 
record that the user has not retrieved or a production propriate sound effects retrieved from a sound effects 
resource that the user has not been allocated. For exam- 35 library Like the producer's notes, the object-oriented 
pie, perhaps during an edit session a user wants to insert database creates "links" which add the sound effects 
the digital video effect of a scene spinning onto the into the edited scene. Alternatively, the sound effects 
screen from a corner. The effect requires the use of a can be edited into a soundtrack for the scene. 
Digital Multi-Effects 473 (DME) production resource. Interface 
In such a situation, the client process running on the 40 in€ venues user imenacc 

workstation would make a request to the Resource The present invention incorporates a user interface 
Allocator over the computer network 450 for the alio- unknown in the prior art which is the subject of the 
cation of a DME 473. If the DME 473 was "free" (not copending '821 and '694 parent applications. The pres- 
curxently being used by anyone else), the Resource ent invention's user interface is discussed below with 
Allocator would allocate the DME 473 to the client 45 reference to its use in the topology of the AV LAN 
process. The Routing Manager would make the neces- configuration of the subject application, 
sary connections on a routing switcher to direct the Referring now to FIG. 24, the present invention con- 
audio and video signals appropriately. After the user ceptually permits a variety of production resources 
has created the desired effect and completed his use of such as graphics $00, text 910 and visual resources 920, 
the DME 473, the client process running on the work- 50 and aural resources 533 to be viewed by a user 930 
station would store the current DME 473 setting for through a "view port", relative in time, along an "event 
future reference. The client process would then return horizon". As will be described, a view port provides a 
the DME 473 to the Resource Allocator so that the perspective view of data contained in a "venue", 
DME 473 would be free to be used by other users at wherein a venue may include a plurality of resources- 
other workstations. 55 such as aural resources 933, visual resources 920, etc. 

The user continues to edit the data and production The data contained in the "venue" is manipulated by the 
resources until he is finished with his edit session. Hav- object-oriented database manager, the viewport merely 
ing completed his edit session, in step 5 of FIG. 23 the acts as a window into the database. It will be noted that 
client process returns the modified data records and the various resources described herein are representa- 
resource allocation information to the Object-Oriented 60 tive of the resources previously described with refer- 
Database Server. Referring to FIG. 22, the data records ence to FIGS. 2-21. 

and production resource allocation information are Referring now to FIG. 23, the present invention's 
returned to the Object-Oriented Database Server and concept of venues is disclosed in relation to three-di- 
Resource Allocator respectively over the computer mensional space. The venue concept of the present 
network 450. 65 invention allows the user 930 to view data represented 

Finally, in step 6 of FIG. 23, the Object-Oriented in alternative view ports of a venue. Relationships be- 
Database Server updates the master element database tween a variety of resources are apparent based on the 
using the returned data records. The Object-Oriented view which the user 930 chooses. As illustrated in FIG. 
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25, a venue is a conceptual three-dimensional space in control devices, such as a spaceball, mouse, or a track- 
which object "elements** reside. An "element" is a ball. 

three-dimensional representation of an abstract data set Referring now to FIG. 27, the graphical user inter- 
associated with a resource coupled to the AV LAN face of the present invention will be described. As 
network 420 of FIG. 19. Depending on the view port 5 shown in FIG. 27, the present invention's user interface 
which is chosen, the elements identify themselves in includes a basic control frame 980 which in practice fills 
various ways. For example, in FIG. 23, element 940 substantially all of the outer border of the display 
may comprise a graphics resource, element 945 may screen. The control frame 980 is the primary context for 
represent an audio resource, element 950 may represent interacting with the user interface of the present inven- 
a textual planning resource, and element 955 may repre- 10 tion, and is, primarily, comprised of four control panels 
sent a music or other audio resource. Viewing a venue which surround an application work area. Three of the 
through a top view port reveals the relative placement panels are visible to the user at all times, and the bottom 
of the various elements in time, both the duration of panel (not shown) is displayed on an as needed basis, 
time that an element represents (such as a film "take") The mode specific action panel 982 comprises, in the 
and the relationship between the resources to a refer- 15 displayed embodiment, a plurality of direct action but- 
ence time, which may be a recording machine, finished tons, or icons, which change with the program mode. In 
film or other multi-media piece. Viewing the right side the illustration of FIG. 27, the mode specific action 
view port reveals versions of the elements, for example, panel 982 comprises a visual element 984, an aural ele- 
audio element 955 includes two versions; namely, ver- ment 986, a text element 988, a graphic element 990, and 
sion 960 and version 965, along with the relative time 20 a process element 992. Although buttons 984, 986, 988, 
lengths of the versions. In addition, it should be noted 990, and 992 are illustrated in FIG. 27, it will be appreci- 
that the user interface of the present invention permits ated that the mode specific action panel buttons/icons 
the use of multiple venues, wherein some or all of the change to support and reflect the current application 
venues may share the same time period, and each venue activities of the user for a particular venue, 
includes its own elements. 25 The control frame 980 further includes a major mode 

For sake of example, assume that the elements illus- panel 994, which comprises an edit button 996, a graph- 
trated in FIG. 25 represent resources for the production ics button 998, an audio button 1000, a plan button 11002, 
of a soap opera. In this example, assume that a produc- and a set up button 1004. It will be noted that although 
tion crew videotaped a number of different scenes that throughout this description icons, buttons, and the like 
comprise the episode. Assume further that there are 30 are described, that the reference to buttons, icons, etc. 
several versions or "takes" of each scene. The different represents any class of displayed items which result in 
scenes are referred to by the designations scene 1, scene some executable action when chosen by a user/pro- 
2, etc. The different versions of each scene are referred ducer. Therefore, although an edit button 996 is dis- 
to as take 1, take 2, etc. closed as part of the control frame 980, it will be appre- 

Viewing an element through the front view port 35 ciated to one skilled in the art that the edit button 996 
reveals the type of resource through the use of an icon may comprise an icon in the form of some edit feature 
label. For example, in the case of an audio resource, the or the like which achieves the same result. In the pres- 
icon label may comprise a graphic representation of a ently preferred embodiment, the buttons comprising the 
musical note. In addition, the various versions are illus- major mode panel 994 are always present for the user no 
trated, as in the case of element 955 in FIG. 25, by 40 matter which venue or other option is selected, 
darkened lines traversing the longitudinal length of the In general, the major mode panel 994 permits a user 
rectangular element image. The version may be acti- to access different venues than the venue currently 
vated, and thereby run, by placing a cursor on the displayed. The specific buttons/icons used in the major 
screen of display 600 over one of the activation buttons mode panel 994 is a function of the particular project in 
on the element, and providing an activation signal, such 45 which the user interface is used as part of. The CPU 510 
as from a "mouse" button, to run that particular version generates and displays a function bar panel 1006 which 
of the resource. Returning to the present example of a displays titles of available functions. The functions 
soap opera production, versions 960 and 965 of the listed on the left side of the function bar panel 1006 are 
audio element 955 may comprise different musical op- referred to as "global utilities", identifying globally 
tions for use during the particular time associated by the 50 available functions, such as "organize", "modify**, etc. 
length of the elements viewed in FIG. 25. Similarly, if In the present embodiment, these functions are pro- 
the resource comprises scenes, then, as is common in the vided no matter which venue or resource is accessed, 
industry, each of these scenes may have associated time Other functions are displayed on the right side function 
codes (such as SMPTE) which comprises the time in bar panel 1006 depending on the context and specific 
and out for each scene. Accordingly, by viewing the 55 application, such as "element", "edit style", Utilities", 
element representing the resource in terms of time, the and "setup* 1 . As is discussed in the copending '694 par- 
time length of each scene would be represented on the ent application, the present invention provides an im- 
element by the length of the particular version lines, for proved method for the selection of function items on 
example 960 and 965, or alternatively, by duration lines the function bar panel 1006. 

967 defining the beginning and end time of each scene of 60 The application specific construction area 1008 com- 
the resource. prises an application area of the display for a selected 

Referring now to FIG. 26, an artist's illustration program mode, and is available for subwindows, user 
shows two producers using workstations of the present views in the display of other elements of work product 
invention. It is intended that every workstation present such as time lines, scripts, scores, preview monitors, etc. 
a single common graphical user interface which enables 65 As shown in FIG. 27, construction area 1008 is desig- 
the user to manipulate production resources in an intu- nated as a resource manager. As will be described, a top 
itive manner. The users interact with the graphical user view port 1010 is also provided in construction area 
interface using a standard keyboard and various cursor 1008. As previously illustrated in FIG. 25, elements 
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representing resources may be viewed in the construe- Assignment of device: 

tion area 1008 and operated on utilizing the functions (e.g.: PI, P2, RECORD, etc.) 

provided on control frame 980. Although the construe- IDENTIFICATION: 

tion area 11008 displays objects in two dimensions, by Alpha-Numeric material 

appropriately selecting the view port, the elements may 5 Identification: e.g.: 

be viewed from all three dimensions. Elements, utilized reel number, reel label, etc. 

in the present invention, directly represent the objects lab roll number, etc. 

that make up a production, such as scripts, segments of SCENE/TAKE INFORMATION: 

video tape, score, scenes, director notes, sound tracks, Content Scene and Take identification. 

etc., and are identified by an icon on the front face of 10 Scene Take file name 

the element as previously described. Elements can be CODES: 

viewed from the front, side, or from the top, or in multi- Time Code and type. 

pie views. As previously discussed with reference to the Origin Time Code and type. 

concept of "resources", the front view o f the element Tjsei- bit Time Code. 

displays the icon label and the type of element may be 15 u&e r bits. Content. 

determined from the icon on its face. Viewing an ele- Frame Numbers, 

ment from the top view port illustrates the relative Edge Numbers. 

length in time the element may have. A view from a side Code Numbers. 

view port illustrates any different versions and their NOTES: 

relative lengths. The element/resource may comprise 20 Assoc j ated Text Notes F or Reel &/or Content, 

several individual elements, and may be bundled into a PRIORITY* 

new compound element much like current users may User ^ ned prk)rity leveh for difTerent versions, 

group graphical elements using a graphics editor. PROCESSING PATH- 

Referring once again to FIG. 27, the top view port Information on an y previous Processing that applies 

1010 is used by the present invention to position ele- 25 ^ material 

ments relative :to ^time by placing them on a time line. As DUB LEVEL, COLOR CORRECTION, 

will be described m more detail below, placing an ele- v g^,^ , 
ment on a bar referred to as the "event horizon" 1012 

integrates the element into the overall time line for the AUDIO ELEMENT ATTRIBUTES 

production and results in the display of time data in the 30 a BFT 

area identified as 1014. Moving an element from con- , A . . , . 

struction region 1008 to the event horizon 1012 results sS^^Si^^ ,dent,ficat,on - 

in the element being assigned a time assignment in the aUUKLfc iJk J.Cfc. 

view port 1010. It will be noted that the view port 1010 J^fSL nJe^prr \ 

corresponds to the top view port view of an element in 35 p^ p, p cpoD n vrr 

the three-dimensional representation of resources de- rJ}^^?^{^ 

scribed with reference to FIG. 25. IDENTIFICATION: 

Referring now to FIG. 28, assume for sake of exam- Alpha-Numeric material identification, 

pie that a user desires to define an element using the R « ! Re f 1 [ a f ' ctc * 

present invention's user interface. An element attribute 40 Ro11 Number, Label.) 

box 1027 is displayed by workstation 300 (see FIG. 18) SCENE/TAKE #: 

once a function item selection identified as "element" Content Scene and Take identification. 

1022 is chosen by a user (See copending '694 parent CODES; 

application for the method of selection of a function Time Codc «»d t YP t - 

item, such as "element"). In the presently preferred 45 Ongin Time Code and type, 

embodiment, element 1022 includes a menu (not shown) User bit Tune Code contents, 

having a plurality of sub-functions for selection. The Frame Numbers, 

function item "element" 1022 is selected by a user TRACKS: 

through the use of an input device previously described Number and Numbers of Source Track 

with reference to FIG. 18. 50 NOTES: 

Once element 1022 is selected, the workstation cou- Associated Text Notes, 

pled to the AV LAN network 420), displays the ele- For Reel &/or Content, 

ment attribute box 1027 as shown in FIG. 28. A user PRIORITY: 

then either selects from a preprinted list of elements, or User assigned Priority levels for different versions, 

defines elements within the element attribute box 1027, 55 PROCESSING PATH: 

the nature of the resource (e.g., music synthesizer 604) Information on any previous Processing that applies 

required for the particular production. Each element to this material. 

has a of a set of required attributes and a set of optional (e.g. Dub level, Equalization, etc.) 

attributes. The required attributes must be filled in order TEXJ ELEMENX ATTRIBUTES 

to create the element. The optional attributes can be 60 

used if necessary. Examples of elements and related LABEL: 

attributes include, but are not limited to the following: User supplied Element identification. 

NAME: 

VISUAL ELEMENT ATTRIBUTES Titlc of TejU type ^ DocumC nt. 

LABEL: 65 (SCRIPT, 

User supplied Element identification. OPENING TITLE, 

(e.g.: Video Tape Recorder, etc.) CHARACTER GENERATOR, ETC) 

SOURCE DEVICE: REVISION: 
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The current Text revision level relevant previous 
revision information. 
FILE TYPES: 
The Names and Types of files as the material exists in 
useable form. 
ASSOCIATED DATA: 
Any previous data files associated with creating the 
current file, 
PROCESSING PATH: 
Information on any previous Processing that applies 
to this material. 

GRAPHIC ELEMENT ATTRIBUTES 

LABEL: 

User supplied Element identification. 
TITLE: 

A user supplied description of the Graphic element. 
REVISION: 

The current Graphic revision level and relevant pre- 
vious revision information. 
FILE TYPES: 
The Names and Types of files as the material exists in 
useable form now. 
ASSOCIATED DATA; 



audio tape record machine wherein the channels are 
coupled to one another. It has been found that it is quite 
useful to display audio channels with the time view port 
1010, in order to correlate the audio channel and time 
interval versus resource. 

Once the required element attributes have been de- 
fined, an element representing a resource is created 
based upon those attributes, and displayed within con- 
struction area 1008 of the control frame 980. Referring 
now to FIG. 29, the present invention's user interface is 
illustrated wherein a plurality of elements identified as 
record VTR 1030, Scene 1 1032, scene II 11034, Dissolve 
1036, Open Title 1040, and Key 1042 are shown. As 
illustrated in FIG. 29, an element such as Record VTR 
1030 includes an icon image (for example, the planet 
Earth in FIG. 29) which describes some aspect of the 
element for identification purposes. Viewing elements 
disposed in construction area 1008 normally corre- 
sponds to viewing a venue and associated resources 
20 through a front view port as shown previously with 
respect to FIG. 25. An element, for example, Record 
VTR 1030 may be moved within the construction re- 



10 



15 



gion 1008 at will by a user 930 through the use of an 
appropriate command sequence, or by simply dragging 
Any previous data files associated with creating the 25 the element around the construction area using a cursor 
current file. control device. However, using the teachings of the 

PROCESSING PATH: present invention, once an element such as Scene 1 1032 

Information on any previous Processing that applies is brought, dragged, or otherwise manipulated down- 
ward to the event horizon 1012, the element is automati- 
30 cally given time significance which is represented along 
the time lines of the top view port 1010. 

As illustrated in FIG. 29, the event horizon 1012 
comprises a horizontal bar with arrows 1050 and 1052 at 
each of its opposite ends. By placing a cursor (not 
35 shown) over arrows 1050 or 1052, and presenting com- 
puter 500 with an activation signal, resource elements 
such as scene 1 1032, scene II 1034, Dissolve 1036, etc. 
may be moved left or right, respectively, and other 
elements may be viewed which are currently not visible 



to this material. 
PROCESSING ELEMENT ATTRIBUTES 
LABEL: 



User supplied Element identification. 
DEVICE IDENTIFICATION: 

Effects Device identification. 
ASSIGNMENT PATH: 

Video and/or Audio routing assignments. 

(e.g. CROSSPOINTS, KEY CHANNELS, ETC.) 
UP LOAD/DOWN LOAD 



CODES: 
Time Line Code and type. 
Effects durations. 
Effects Source codes. 

Effects Edge Numbers for optical printer outputs. 
PROCESSING: 
Effects types, (e.g. CUTS, FADES, DISSOLVES, 
WIPES, KEYS, DME, ETC.) 



File input/output for created effects save and recall. 40 on the event horizon in the control frame 980. The use 

of arrows 1050 and 1052 permits a user to scan through 
elements disposed on the event horizon 1012 and view 
the elements not only in relative position, but in relative 
time. This view corresponds to that of a user 930 in 
45 FIG. 24 scanning the resources in that figure, such as 
special effects 900, editing 910, video 920, etc. In addi- 
tion, it will be appreciated that the relative position of 
the element may be changed by simply "dragging" an 
element such as scene I 1032 off of the event horizon 
Once the element attributes have been defined, com- 50 1012, moving other elements into that time slot along 
puter 500 utilizes appropriate network connections over the event horizon, and replacing scene 1 1032 at some 
AV LAN network 420 to the various resources, such as other location along the event horizon. A redistribution 
the VTR 602, music synthesizer 604, audio tape re- of the element's relative position along the event hori- 
corder 606, production switcher 608 (see FIG. 18) to zon would correspond in FIG. 25 to, for example, swap- 
access the resource via the user interface. Accordingly, 55 ping element 120 for element 950 and vice versa, 
a virtual connection via computer 500 has been created Once an element is placed upon the event horizon 
between the user interface comprising the control frame 1012, position data relative in time to other elements is 
980 as displayed on the display 600 of a workstation, illustrated along the time lines of the top view port 1010 
and the particular resource coupled through the AV as shown. Conceptually, the reader is directed to FIG. 
LAN network interface 420. Continuing to refer to 60 25 which illustrates in three dimensions the placement 



FIG. 28, within the top view port 1010, time elements 
corresponding to the particular resource have addi- 
tional information that is revealed in the time line asso- 
ciated with the top view port 1010. Tracking buses 1020 
provide information regarding the recording of audio 65 
channels 1 through 4, and a video channel 1. In practice, 
a source tape machine (not shown) coupled to, for ex- 
ample, the audio network of FIG. 7 supplies audio to an - 



of elements relative to one another in time. However, 
due to the limitations of display 600, the time view port 
1010 is utilized to display time along the ±Y direction, 
with time T 0 being at the lower portion of the display as 
illustrated in FIG. 29. In addition, as shown in FIG. 29, 
the number of versions of, for example, scene 1 1032, is 
also displayed as versions 1060, 1062, 1064, 1066, 1068. 
It will be appreciated by the reader that the display of 
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an element such as scene 1 1032 corresponds to the prior presents the user with an emulation of the device's 

description of a resource having multiple versions physical user interface. For example, an emulation of 

which may be activated by selecting (for example, by the record VTR 1030 user interface can be displayed in 

placing a cursor over version H0S8 and providing an the application area with rewind, play, stop, fost-for- 

activation signal) a version such that the version is 3 ward, and all the other buttons present on the actual 

"run" within the window of scene 1 11032. Accordingly, VTR. These On-screen buttons can be manipulated 

user 530 may view the entire version of scene I which with a cursor control device such as a track ball or 

has been selected, within the icon window comprising . mouse thereby operating the device. In this manner, the 

the scene. In general, in the present and preferred em- present invention can capitalize on the user's previous 

bodiment, and throughout this Specification, placing a 10 experience by presenting the user with an interface that 

cursor over an icon or other executable function and is the same or similar to one the user has used before, 

"double clicking" using a cursor control device such The present invention can accomplishes this goal with 

that two consecutive signals are provided to the com- the combination of on-screen "virtual interface" output 

puter SCO executes the function which has been se- displays and "assignable input devices", 

lected, and, more particularly, reveals any attributes 13 A "virtual interface" is an on-screen display that is 

and/or contents of the icon. Double clicking on a time design to emulate the display of a physical resource 

function such as time block 400 for scene I (FIG. 29) such as a VTR, production switcher, or DME. In this 

may be configured such that time code (i.e. SMPTE) is manner a output display that the user is familiar with is 

displayed. More particularly, in the present example, presented to the user. 

SMPTE time code for the beginning and end of each 20 An "assignable input device" is a physical input de- 
version within scene 1 1032 may be displayed within the vice coupled to an edit workstation, such as a joystick 
time line view port 1010. or transition bar, that can be assigned to transmit input 

Referring now to FIG. 30, control frame 980 is illus- information to a software application running on the 
trated in which a new scene 1 1070 has been "dragged" edit workstation. (See FIG. 18). For example, a rotary 
upward off of the event horizon 1012 into the construe- 25 dial may be coupled to an edit workstation as an input 
tion area 1008. As illustrated in FIG. 30, once an ele- device. The software on the workstation can "assign" 
ment, in the present example scene 1 1070, is moved off input information from the dial to any function it de- 
of the event horizon 1012, timing information viewed sires. If a audio control board is being emulated, the dial 
through top view port 1010 corresponding to scene I can be assigned to a volume function. If a video tope 
1070 is no longer displayed. Elements such as scene II 30 recorder is being emulated the dial can be assigned as a 
1072, dissolve 1077, open title 1080 or key 1082 may be "jog/shuttle" dial to move the video tape, 
repositioned along the event horizon S012 and/or modi- By providing a large variety of assignable input de- 
fied in terms of time sequence as viewed through top vices such as keyboards, rotary dials, transition bars, 
view port 1010, relative to one another. Alternatively, pushbuttons, optical tracks, and trackballs, that can be 
and as shown in FIG. 30, element attribute box 1027 35 connected to an edit workstation, the user can build a 
may be selected and the attributes of scene 1 1070 may user interface that suits their needs. For example, a 
be modified, or an entirely new element may be defined, beginner may be satisfied with a mouse which enables 
to replace scene I 1070 along the event horizon 1012. the user to manipulate on screen representations of the 

It will be appreciated that a user utilizing the inter- physical production resource. On the other hand, an 

face comprising the present invention defines elements 40 experienced video editor may desire to create a physical 

in the construction area 1008 by specifying attributes of copy of the control panel of a production switcher 

the element in the element box 1027. In addition, multi- which he is familiar with. The input devices provided 

pie elements may be created within the construction are constructed modularly such that they connected 

area 1008. The created elements may then be selectively together easily, 

dragged to the event horizon 1012 in an arrangement 45 _ TT _ , 

and order selectedbytheuser930.lt will further be Future User Interfaces 

appreciated from the above discussion by one skilled in The present invention has been described and illus- 

the art that the present invention's user interface per- trated with reference to the Figures as applied to a 

mits the utilization of resources within the systems illus- display 600, and using assignable input devices, such as 

trated in FIGS. 2-21, permits selective modification of 50 digital pad 345, trackball 360, etc. However, the teach- 

the resources, and through the use of the interface of the ings of the present invention may be applied to numer- 

present invention provides a consistent interface for the ous other display devices and input mechanisms. For 

production of a multi-media work. The user interface of example, the present invention may be practiced using 

the present invention, through the use of a common what is known as "virtual reality" input devices, such as 

control frame 980 as displayed on display 600, allows 55 but not limited to, a data input glove, body glove input 

artists, musicians, and other media professionals to ere- device, etc. In addition, the present invention may be 

ate, modify and rearrange resources comprising a pro- utilized with eye goggle displays which are worn by a 

duction with flexibility heretofore unknown in the art. user and coupled to the computer display system via 

The present invention's concept of venues, and the fiber optics, wires and the like. When the present inven- 
ability to operate on resources in three dimensions, 60 tion is utilized in conjunction with a virtual reality sys- 

provides a user with flexibility not present in any prior tern, the user interface of the present invention would 

user interface for computer display systems, as well as be viewed by a user through input goggles as being 

multi-media production systems known in the past. suspended in space. Interaction with the interface by 

the user may be done using an input glove or other 

The Virtual User Interface 65 yirtual reality devjce woni by the uscr Accordingly, it 

Referring back to FIG. 29, in the case of elements will be appreciated that the user interface of the present 
which represent standard devices such as record VTR invention is not limited to conventional input or display 
1030, the present invention can display a window which devices. The reader is referred to the following refer- 
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ences for a further description of existing and proposed 
virtual reality systems. Rheingold, Virtual Reality, Sum- 
mit Books (1991), pages 70, 148-49; Computerized Real- 
ity Comes of Age, NASA Tech Briefs, page 10, August 
1990 (Vol. 14, number 8); Iwata, Artificial Reality with 5 
Force-Feedback Development of Desktop Virtual Space 
with Compact Master Manipulator, ACM SIGGRAPH, 
August 1990 (Vol. 24, number 4); Nash, Our Man in 
Cyberspace Checks out Virtual Reality, Computerworld, 
Oct. 15, 1990; Daviss, Grand Illusions, Discover, June 10 
1990. 

While the present invention has been described in 
conjunction with a few specific embodiments identified 
in FIGS. 2 through 30, it will be apparent to those 
skilled in the art that many alternatives, modifications 15 
and variations in light of the foregoing description are 
possible. Accordingly, the invention is intended to em- 
brace all such alternatives, modifications and variations 
as may fall within the spirit and scope of the invention 
as disclosed. 

I claim: 

J. An integrated multi-media production and author- 
ing system, said system comprising: 
a digital communications network for carrying a ^ 
plurality of addressed messages such that commu- 
nication on the digital communications network 
takes place in real-time; 
a plurality of workstations comprising digital com- 
puters coupled to said digital communications net- 30 
work, said workstations transmitting and receiving 
said plurality of addressed messages over said digi- 
tal communications network; and 
a plurality of production resources including audio 
and video production and editing devices, said 35 
production resources coupled to said digital com- 
munications network, said production resources 
transmitting and receiving said plurality of ad- 
dressed messages on said digital communications 
network such that a user working with any of said 40 
plurality of workstations may access any of said 
plurality of production resources coupled to said 
digital communications network to create and edit 
a multi-media work; 
said plurality of workstations including a display 45 
system having a display and user input means, said 
display system comprising: 
a user interface for display on said display, said user 
interface displaying representations of said pro- 
duction resources coupled to said digital com- so 
munications network with which a user interacts 
using said user input means; 
said representations of said production resources 
comprising at least three dimensions and being 
arranged in a venue of at least three dimensions, 55 
each of said dimensions corresponding to an 
attribute of said production resources which may 
be viewed using said user interface from a plural- 
ity of view ports, such that viewing said repre- 
sentations of said production resources from 60 
different view pons results in the display of dif- 
ferent attributes of said production resources; 
said representations of said production resources 
being arranged in said venue such that each of 
said production resources is disposed relative to 65 
one another in time and space within said venue; 
manipulation means coupled to said user input 
means for selectively positioning said representa- 
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tions of said production resources within said 
venue. 

2. The system as defined by claim 1 wherein said 
venue may be viewed from six view ports, namely, a 
top, left, right, rear, bottom and front view port. 

3. The system as defined by claim 2 wherein viewing 
said venue from a top view port reveals the relative 
positions of each of said three dimensional representa- 
tions of said production resources relative in time to one 
another. 

4. The system as defined by claim 3 wherein viewing 
said venue from a front view port reveals an icon identi- 
fying the type of production resource each of said rep- 
resentations represent. 

5. The system as defined by claim 4 wherein viewing 
said venue from a side view port reveals versions of said 
production resource and the lengths of said versions 
relative to one another. 

6. The system as defined by claim 5 wherein viewing 
said venue from a front view port further reveals ver- 
sion activation buttons, one of said buttons for each of 
said versions, such that said user, using said user input 
means may selectively activate said versions. 

7. The system as defined by claim 6 wherein if said 
user activates one of said versions, said version is exe- 
cuted within said representation of said production 
resource, and may viewed through said front view port 
of said venue on said display. 

8. The system as defined by claim 7 wherein said user 
interface includes interface generation means for gener- 
ating and displaying a control frame using said display 
means to display selected view ports of a venue, said 
control frame including a plurality of command options 
which may be selected by said user using said user input 
means. 

9. The system as defined by claim 8 wherein said 
control frame further includes a first area for defining 
said attributes of said resources arid displaying said 
representations of said resources once said attributes are 
defined. 

10. The system as defined by claim 9 wherein said 
first area displays said representations of said produc- 
tion resources in a venue initially from a first view port. 

HI. The system as defined by claim 10 wherein said 
user may selectively change view ports from said first 
view port by selecting one of said command options. 

12. The system as defined by claim 11 wherein said 
control frame further includes a second area for display- 
ing said top view port of said venue, such that timing 
data representing relative time associated with said 
production resources is displayed in said second area. 

13. The system as defined by claim 12 wherein said 
control frame further includes a event horizon bar, such 
that the placement of a representation of a production 
resource on said bar results in said timing data being 
displayed in said second area of said control frame. 

14. The system as defined by claim 13 wherein select- 
ing an Element command option results in the display of 
an element attribute box for defining said production 
resource attributes. 

15. The system as defined by claim 14 wherein said 
representations of said production resources may be 
selectively placed on said event horizon bar, thereby 
altering the relative placement of said representations in 
said venue in time and space. 

16. The system as defined by claim 15 wherein said 
command options of said control frame further includes 
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a plurality of mode specific action options on the pe- 
riphery of said control frame. 

17. The system as defined by claim U wherein said 
command options of said control frame further includes 

a plurality of major mode options on the periphery of 5 
said control frame. 

18. The system as defined by claim 17 wherein said 
first view port initially displayed comprises the front 
view port. 

19. The system as set forth in claim 1 wherein each of 10 
said plurality of production resources are coupled to 
said digital communications network through a device 
translator, said device translator comprises: 

a network interface coupled to said digital communi- 
cations network such that said device translator 15 
transmits and receives said plurality of addressed 
messages over said digital communications net- 
work; 

a centra] processing unit coupled to said network 
interface, said central processing unit programmed 20 
such that the plurality of addressed messages re- 
ceived over said digital communications network 
are translated into a plurality of device-specific 
commands; and 
a device-specific interface coupled to said central 25 
processing unit and coupled to said production 
resource associated with said device translator, 
wherein said device translator communicates said 
plurality of device-specific commands to said pro- 
duction resource; 30 
wherein said device translator translates said received 
plurality of addressed messages into said plurality of 
device specific commands. 

20. The system as set forth in claim 19 wherein said 
device translator includes a programmable translation 35 
data set stored in a memory means coupled to said cen- 
tral processing unit such that said device translator can 
be programmed to translate said plurality of addressed 
messages into a plurality of device-specific commands 
for a plurality of different production resources. 40 

21. The system as set forth in claim 20 wherein said 
programmable translation data set is downloaded into 
said memory means in said device translator through 
said digital communications network. 

22. The system as set forth in claim 1 further compris- 45 
ing a library management system coupled to said digital 
communications network. 

23. The system as set forth in claim 22 wherein said 
library management system comprises: 

a library of digital media storage units; 50 
means for accessing said digital media storage units, 
said accessing means coupled to said digital com- 
munications network; 
means for loading said digital media storage units into 
said accessing means, said loading means coupled 55 
to said digital communications network. 

24. The system as set forth in claim 23 wherein said 
digital media storage units in said library management 
system comprise magnetic tapes. 

25. The system as set forth in claim 24 wherein said 60 
accessing means in said library management system 
comprise digital video tape recorders. 

26. The system as set forth in claim 23 wherein said 
accessing means in said library management system 
comprise digital data tape recorders. 65 

27. The system as set forth in claim 23 further com- 
prising a matrix routing switcher coupled to said digital 
communications network. 



28. The system as set forth in claim 27 wherein said 
matrix routing switcher is coupled to said plurality of 
production resources, said matrix routing switcher es- 
tablishing a plurality of signals paths between said pro- 
duction resources. 

29. An integrated multi-media production studio 
comprising: 

a plurality of local area networks coupled to each 
other wherein each said local area network carries 
a plurality of addressed messages; 
a plurality of production resources devices coupled 
to said local area networks, each of said plurality of 
production resources able to transmit and receive 
said plurality of addressed messages; and 
a plurality of workstations coupled to said local area 
networks, each of said plurality of workstations 
able to transmit and receive said plurality of ad- 
dressed messages wherein a user working on any 
said plurality of workstations may transmit and 
receive messages to any of said plurality of produc- 
tion resources coupled to said plurality of local 
area networks; 
said plurality of workstations including a display 
system having a display and user input means, said 
display system comprising: 
a user interface for display on said display, said user 
interface displaying representations of said pro- 
duction resources coupled to said digital com- 
munications network with which a user interacts 
using said user input means; 
said representations of said production resources 
comprising at least three dimensions and being 
arranged in a venue of at least three dimensions, 
each of said dimensions corresponding to an 
attribute of said production resources which may 
be viewed using said user interface from a plural- 
ity of view ports, such that viewing said repre- 
sentations of said production resources from 
different view ports results in the display of dif- 
ferent attributes of said production resources; 
said representations of said production resources 
being arranged in said venue such that each of 
said production resources is disposed relative to 
one another in time and space within said venue; 
manipulation means coupled to said user input 
means for selectively positioning said representa- 
tions of said production resources within said 
venue. 

30. The system as set forth in claim 29 wherein each 
of said plurality of production resources are coupled to 
said local area network local area networks through a 
device translator. 

31. The system as set forth in claim 30 wherein said 
device translator comprises: 

a network interface coupled to said local area net- 
works such that said device translator transmits 
and receives said plurality of addressed messages 
over said local area networks; 

a central processing unit coupled to said network 
interface, said central processing unit programmed 
such that the plurality of addressed messages re- 
ceived over said local area networks ore translated 
into a plurality of device-specific commands; and 

a device-specific interface coupled to said central 
processing unit and coupled to said production 
resource associated with said device translator, 
wherein said device translator communicates said 
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plurality of device-specific commands to said pro- 
duction resource; 
wherein said device translator translates said received 
plurality of addressed messages into said plurality of 
device specific commands. 5 

32. The system as set forth in claim 31 wherein said 
device translator includes a programmable translation 
data set stored in a memory means coupled to said cen- 
tral processing unit such that said device translator can 
be programmed to translate said plurality of addressed 10 
messages into a plurality of devicospectfic commands 
for a plurality of different production resources. 

33. The system as set forth in claim 32 wherein said 
programmable translation data set is downloaded into 
said memory means in said device translator through 
said digital communications network. 

34. A method for accessing and editing a set of multi- 
media elements in a distributed computing environ- 
ment, said method comprising the steps of: 2 o 

providing a digital communications network coupled 
to a plurality of multi-media production resources 
having defined attributes and a plurality of edit 
workstations each of said workstations including a 
central processing unit (CPU) coupled to a display 25 
and user input means, one of said edit workstations 
executing a database server process and an alloca- 
tion and routing process; 

commencing an edit session on an edit workstation by 
requesting a set of multi-media elements and pro- 30 
duction resources using a client process running on 
said edit workstation; 

extracting said set of multi-media elements from a 
multi-media element database using said database 
server process; 35 

providing said set of multi-media elements from said 
database server process to said client process; 

allocating production resources from a production 
resource allocation and routing database using said 
allocation and routing process; 40 
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providing said allocated production resources from 
said allocation and routing process to said client 
process; 

editing said multi-media elements using said client 
process on said edit workstation including the steps 
of: 

providing a user interface on said screen of said 
display for displaying representations of said 
production resources coupled to said display 
system with which a user interacts through said 
user input means; 

generating and displaying a control frame on said 
display using interface generation means coupled 
to said CPU, said control frame including a plu- 
rality of command options which may be se- 
lected by said user using said input means, and 
further including an event horizon bar, such that 
the placement of a representation of a resource 
on said bar using said user input means results in 
predetermined data being displayed in said con- 
trol frame, and said representations of said re- 
sources being disposed relative to one another in 
time; 

said representations of said production resources 
comprising at least three dimensions and being 
arranged in a venue comprising at least three 
dimensions which may be viewed using said user 
interface from a plurality of view ports, such that 
viewing said representations of said resources 
from different view ports results in the display 
on said screen of different attributes of said re- 
sources; 

completing said edit session by returning multi-media 
elements to said database server and returning said 
allocated production resources to said allocation 
and routing process; 

updating said multi-media element database and said 
production resource allocation and routing data- 
base. 

d o o o * 
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